Deep Separable Hypercomplex Networks
نویسندگان
چکیده
Deep hypercomplex-inspired convolutional neural networks (CNNs) have recently enhanced feature extraction for image classification by allowing weight sharing across input channels. This makes it possible to improve the representation acquisition abilities of networks. Hypercomplex-inspired networks, however, still incur higher computational costs than standard CNNs. paper reduces this cost decomposing a quaternion 2D module into two consecutive separable vectormap modules. In addition, we use 4 and 5D parameterized hypercomplex multiplication-based fully connected layers. Incorporating both yields our proposed CNN, novel architecture that can be assembled construct deep (SHNNs) classification. We conduct experiments on CIFAR, SVHN, Tiny ImageNet datasets achieve better performance using fewer trainable parameters FLOPS. Our model achieves almost 2% CIFAR SVHN more 3% ImageNet-Tiny dataset takes 84%, 35%, 51% ResNets, quaternion, respectively. Also, state-of-the-art benchmarks in space.
منابع مشابه
Hypercomplex Liquid Crystals
Hypercomplex fluids are amalgamations of polymers, colloids, or amphiphilic molecules that exhibit emergent properties not observed in elemental systems alone. Especially promising buildingblocks for assembly of hypercomplex materials are molecules with anisotropic shape. Alone, these molecules form numerous liquid crystalline phases with symmetries and properties that are fundamentally differe...
متن کاملLinear Algebra Approach to Separable Bayesian Networks
Separable Bayesian Networks, or the Influence Model, are dynamic Bayesian Networks in which the conditional probability distribution can be separated into a function of only the marginal distribution of a node’s parents, instead of the joint distributions. We describe the connection between an arbitrary Conditional Probability Table (CPT) and separable systems using linear algebra. We give an a...
متن کاملTail Asymptotics for Monotone-separable Networks
A network belongs to the monotone separable class if its state variables are homogeneous and monotone functions of the epochs of the arrival process. This framework contains several classical queueingnetworkmodels, includinggeneralized Jacksonnetworks,maxplus networks, polling systems, multiserver queues, and various classes of stochastic Petri nets. We use comparison relationships between netw...
متن کاملDetecting Overlapping Communities in Social Networks using Deep Learning
In network analysis, a community is typically considered of as a group of nodes with a great density of edges among themselves and a low density of edges relative to other network parts. Detecting a community structure is important in any network analysis task, especially for revealing patterns between specified nodes. There is a variety of approaches presented in the literature for overlapping...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... International Florida Artificial Intelligence Research Society Conference
سال: 2023
ISSN: ['2334-0762', '2334-0754']
DOI: https://doi.org/10.32473/flairs.36.133540